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Abstract 

We  prove  the  existence  of  a  Nash  equililninm  of  a  class  of  continuous  time  stopping  games. 
Under  a  strict  monotonicity  condition,  there  exists  a  unique  symmetric  eeiuilibrivim  for  a 
symmetric  stopping  game.  Any  Nash  erjuilibrium  of  a  stopping  game  is  suhgame  perfect. 
The  machinery  employed  in  the  analyses  is  the  (^rnrrnl  Throvy  of  Prnre.s.se.s .  hi  the  next 
version,  we  will  provide  conditions  imder  which  there  is  a  unique  Nash  equilibrium  for 
general  stopping  games  and  will  give  examples  of  our  general  theory. 
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1.  Introduction 

This  jiappr  presents  the  theoretic  findings  on  the  rontinnnns  time  version  of  the  general  stopping 
games.  The  game  theoretic  extension  of  the  optimal  stopping  theory  in  the  discrete  time  framework 
was  initiated  by  Dynkin  [1969]  in  analysis  of  a  class  of  two  i)erson  zero  sum  stopping  games.  The 
modifirations  and  extensions  include  C'hapnt  [1974]  in  zero  sum  stopping  games  and  Mamer  [198G| 
in  two  jierson  nonzero  sum  stojjping  monotone  games. 

The  widespread  use  or  potential  use  of  stopping  games  can  lie  found  in  economics,  finance,  and 
management  science.  Examples  include  the  entry  and  exit  decisions  of  firms,  job  search,  optimal 
investment  in  research  and  develojmient,  and  the  technology  ti-aiisitinn  in  influstries.  (See  Fine  ancl 
Li  [1986],  Mamer  and  McCardle  [1985],  Reingainini  [1982]  etc)  In  fact,  any  stochastic  dynamic 
game  in  which  each  palyer's  strategy  is  a  single  dichotomf)us  flecision  at  each  time  can  be  formulated 
as  a  stopping  time  problem.  Fine  and  Li  [1986]  also  show  that  for  this  tyjx^  of  game  the  stopping 
time  cfjuilibria  corresjiond  to  the  subgame  perfect  etjuilibria  in  the  natural  extensive  form  game. 

However,  one  of  the  major  weakness  of  the  discrete  time  stoj)ping  games  is  the  multiplicity  of 
equilibria,  hi  an  oligopolistic  exit  game.  Fine  and  Li  [1986]  pointed  out  that  the  nniltiplicity  of 
equilibria  is  a  consequence  of  the  fact  that  the  industry  demand  process  can  jump  from  a  point 
where  lioth  firms  are  viable  as  duopolists  to  a  i>oint  where  neither  firm  is  vialiN^  as  a  duopolists,  but 
each  is  viable  as  a  monopolist.  This  jiroblem  might  be  avoided  by  assuming  that  the  information 
evolves  continuously,  which  could  be  valid  only  in  a  continuous  time  framework.  This  is  one  of  the 
reasons  that  motivate  this  study. 

The  only  work  we  are  aware  of  dealing  with  game  theoretic  extension  of  continuous  time 
optimal  stopping  problems  is  Chai)ut  [1974].  He  analyzcxl  a  two  jjerson  zero  sum  stopj)ing  game 
proposed  l)y  Dynkin  [1969]. 

Our  sttuly  is  composed  of  two  jiarts.  hi  this  jiart,  we  start  with  a  general  setting  of  an  A^-person 
continuous  time  stop|>ing  game  assuming  the  payc:)ff  processi^s  are  oi)tional  jirocesses.  A  martingale 
ai)proacli  (in  contrast  to  the  excessive  function  ajiprfjacli  in  the  Markov  setting)  is  adoj)ted  to 
show  the  existence  of  the  reaction  correspondences  of  play<'rs  under  fairly  general  conditions.  The 
existence  of  a  Nash  equilibriinn  in  games  with  a  monotone  i)ayotf  structures  follows  from  Tarskis 
lattice  theoretic  fixed  j)oint  theorem.  We  also  show  that  there  is  a  uniqu(^  symmetric  equilibrium  if 
further  structures  are  imposed.  Moreover,  any  Nash  (-(luilibrium  of  th(^  stojiping  game  is  a  subgame 
perfect  equilibrium  as  in  the  discrete  time  case. 

This  version  is  a  prelimilary  and  incomplete  draft.  The  continuation  of  this  work  anticijiates 
the  uniqueness  of  an  cfjuilibrium  when  information  is  reveaiecl  continuously.  We  will  also  construct 
useful  examples  in  economics,  finance,  and  management  science. 


2.    Tho  formulation 

Lit  (W,  J .  P)  1)C  a  roiiiplotr  pmhnliility  span-  ofjuiiiix-fi  with  an  iiiriTHsiiiK  family  of  suli-pifriiia- 
firl.l  of  /,  or  a  fi/fmfjnii.  F  =  {Ti-f  ^  3?+},  tliat  satisHi-s  the  tisiia/  ntuilitirtiis: 

1.  roiniilrtr:   To  roiitaius  all  tlir  r-iiull  sets; 

2.  right -rout  iininiia.   7,  -  n,>/  ^.  V<  G  3R4 . 

Wr  also  assuiiio  Miat  Jn  i^  nhiinfit  trivial  in  that  it  is  <?:ciicrat((l  by  W  ami  all  the  r-imll  sets. 
Wp  shall  (Iciiotc  V/g^j     .^r  •!"'  ?iii;tll<''^t  si^iiia-firlfl  roiitaiiiiu^:  {7,:f  ^  9?  f  }  l>y  ^oc- 

Wr  iiitrri)rrt  oarli  w  E  W  to  he  a  coinplctr  drsniiitioii  of  tli<'  state  of  the  world.  The  filtration 
F  models  tho  way  information  ahout  tlir  true  statr  of  tho  world  is  nvcalcfl  ov(-r  time.  In  a  discrete 
time  finite  state  setting,  a  filtration  ran  he  tlionRlit  of  as  an  event  tree. 

Before  we  j)roreed.  some  definitions  are  in  order. 

A  i)rofess  X  is  a  mapping  A'  :  U  X  3?^.  ►->  3?  that  is  nn-asnraMe  with  resi)ert  to  J  ®  S(3?+), 
the  prndurt  sigma-field  generated  l>y  T  and  the  Borel  sisma-fieM  of  9?^.  A  i>roress  X  is  said 
to  he  ndaptrd.  if  X(t)  is  measurable  with  respect  to  J,  V^  G  5R+.  A  process  is  pro^re.s.sive/y 
Hira.siira/>/e  if  V«  G  9?+,  the  mapping  (w.x)  >-»  vY(a;..«)  of  U  x  [().  f]  into  3?  is  measurable  with 
respect  to  the  product  sigma-field  7,  (g)  5(10,  <)),  where  as  usual  5([n,f])  is  the  Borel  sigma-field  of 
((),<].  The  optiouH}  sigmH-Rrh].  denoti-f]  by  0.  is  the  sigma-field  on  U  X  5R+  generated  by  adai>ted 
processes  having  right-continuous  i)atlis;  cf.  ('Innig  and  Williams  [1983).  A  process  is  ojitional  if 
it  is  measurable  with  respect  to  0.  Naturally,  any  adapted  jirocess  with  right-continuo<is  paths  is 
optional.  It  is  al.so  known  that  any  optifmal  process  is  ada])ted;  cf.  Chung  and  Williams  [1083]. 

Let  ^+  denote  the  extended  jiositive  real  line.  A  Markov  tiiiir  T  is  a  fiuiction  from  U  into  3?+ 
8nch  that 

{w  G  12  :  T{uj)  <t}e7,         yt  G3i+. 

A  Markov  time  T  is  said  to  be  a  st'tjijiinK  timr  if  P{T  <  00}  =  I.  A  st(.].])iii'';  tiui<-  T  is  bounded 
if  there  exists  a  constant  K  G  3?+  P'lrh  that  r{T  <  K)  ^  i. 

Let  T  be  a  Markov  time.  The  sij^niia-field  7t ■  ^li"  collection  of  <vents  jninr  N.  T.  consists  of 
all  events  A  ^  7oc  ""fl*  *hfi\ 

Af]{T<t}e7,     V/.  g3?+. 

Let  X  be  an  ojitional  jirocess.   Putting 

A'(+oo)  =  limsup,X(0. 

it  follows  from  Dellaclierie  and  Meyer  [1978.  Theorem  IV  90]  that  A'(  +  Oo)  is  an  .-xtended  real-valued 
random  variable.  This  is  the  convention  we  will  use  for  any  ojitional  jirocess  to  aiijiear.  It  is  also 
ea.sy  to  check  that  the  process  {X{l):  /  G  ^+  }  is  ojitiouMl     I)  tli.Mi  f'.jlows  from  sinnl.ir  arguments  in 


Thenrnn  IV. G4  of  Dellarhrrie  and  Moyor  [1978]  that  X{uj.T{uj))  is  an  cxtcnrlrd  roal-vahicd  random 
variable  measurable  with  respect  to  Tj. 

An  optional  process  X  satisfies  condition  A~  if 

^[siip^"(()]  <  oo, 

where  E\]  denotes  the  expectation  with  resjiect  to  P.   It  satisfies  conflition  ^4"*"  if 

E{sx\pX'^{t)]  <  OO. 

Coming  back  to  economics,  we  consider  an  A^  i)layer  dynnitiir  stopping  game.  Players  are 
indexed  by  i  =  1,2, . . . ,  N.  The  payoff  of  this  game  is  described  by  a  family  of  adapted  processes 

z,{uJ,t:T_,(w));t  e  9?+.  r=  1,2 A^. 

where  r_,-  runs  through  all  (A^  —  l)-tuple  of  Markov  times.  Interpret  2,(w./;r_i)  to  be  the  payoff 

that  player  i  receives  in  state  w  when  his  strategy  is  T,  and  T,(u;)   =  t.  if  r_,  are  the  strategies 

employed  by  players  other  than  i.  We  assume  that  payoff  processes  are  optional  jirocesses  satisfying 

condition  A~ . 

(liven  the  strategy  of  his  opponents  T_,.  the  objective  of  jihyer  »'  is  to  find  a  Markov  time  T,- 

that  solves  the  following  program: 

snp  E{z,{T,:T^i)].  (2.1) 

T,eT 

where  T  is  the  collection  of  all  Markov  times. 

A  Nnfili  eq\ii]ihniim  of  the  stojiping  game  is  an  A^-tujile  of  Markov  times  (T,;  ?'  =  1,2 N) 

such  that  Ti  solves  (2.1)  for  alU'  =  r,  2 N. 

A  Nash  equilibrium  of  the  stoj)ping  ga.me  {T,;?'  =  1,2,  ...  .A^}  is  said  to  Ix'  suJigamr  perfect 
if  given  a  Markov  time  S,  putting  A;  =  {T,-  >  S}.  we  have 

E{z,{T^;T_i)\rs]  >  E[z,{t,;T.,]\Ts]     "... 
on  the  set  Aj  for  all  Markov  times  r,-  such  that  r,-  >  S  on  the  set  A,,  for  all  i  =  1,2 A^. 

3.  Existence  of  reaction  functions 

In  this  section  we  shall  show  that  given  the  strategy  of  his  oj)j)onents,  a  jiiayer's  best  response 
always  exists. 

Some  definitions  are  first  given. 

A  sujiormnrtingHlr  X  is  an  optional  process  such  that  for  all  bounded  stojijung  times  T  and 
S  with  T  <  S  both 

E{X-{S)]  <  oo  (3.1) 


aud 

E\XIS)\Tt\  <  XIT)     ......  (3.2) 

fire  satisfirrl,  wlirrr  X~{t)  =  u\nx\-' X(t).()].  the  iirRiitivc  i);irt  nf  X{t].   A  prorrss  is  a  iiuirtingah 
if  Iifitli  X  and  —X  aro  siiprrinartiiipalrs. 

Remark  3.1.  Traflitionally.  a  ^rwrnlizri]  s\iiniiii:titiii'^:ilf  is  an  a'la])tr(l  jirnross.  not  nrrcs- 
sarily  njititmal.  satisfying  (3  1)  anii  (-T  2)  Any  K''ii<'rali7.('(l  sii])iMiiiartin^alc  in  tlic  traditional  sonsc 
with  riglit  rontinnons  jiatlis  is  a  sn]icrniartinKalc  rirfincfl  al)ov(' 

Mcrtcns  [19G9.  TlK^orrni  1)  lias  sliown  that  almost  all  of  the  ])atlis  of  a  snpcrniaitinf^alr  havo 
riRJit  and  left  limits  and  arr  n])i>ci-  si'mi-rontinuons  fiom  the  lifrlit. 

A  snprrmartinfjalo  X  is  vrgnliiv  if  for  every  pair  of  stopi)in<.':  times  T  <  S  the  expertation 
£^(A'(.'>))  exists  and 

^[A'(.S-)|  Jrl  <  X{T)     a... 

A  supermartingale  {X(/)}  is  .sii/)e;-  rrgnlnr  if  foi'  ev<-ry  j)air  of  Markov  times  T  <■  S  the 
expertation  £^[-Y(.9)]  exists  and 

^iA'(.S')|77-l  <  A'iT-)     a...  (3.3) 

The  following  terhniral  lemmas  are  keys  to  the  main  results  in  this  sertion. 

Lemma  3.1.   Lrt  {X{t)}   }>r  a  .sii/)er  irgulnr  sujicniiHitingnlr  nniJ  Irt  T  nnd  S  }<r  two  Mnikov 
tiinrs.    Thru 

E\X{S)\Tt]  <  X{T)     'i..«.  on  the  srt  {S  >  T) 

ProKf     Let   A  =   {S   >  T]     Sni)pose  tin-  assertion   is  not   trm-     Then  there  exists  A'  ^   Tt  w-ith 
r(A')  >  0  and  A'  C  A  snrh  that 

E\X{S)\7t]  >  X{T)     -;  ,"    on  th.'  set  A'. 

Define  two  Markov  times  as  follows: 

T'{w)  -  T{u})  if  w  e  A'. 

=  +00  otherwise: 
S'(i^)  =  S(uj)  if  w  e  A'. 

—  -foo  otherwise. 

Throroni   IV. 53  of  D<dlaelierie  and  Meyer  [1978]  ensures  that   T'  ami  S'  ar<'  Markov  times.     By 
rf)nstrurtion,  almost  surely,  S'  >  T',  S  <  .*?',  and  T  <  T' .   Ihnce  /j-'  C  7$'. 
Since  ,Y  is  a  sujx-r  rej^ular  supermartinRale,  we  must  have 

^|A-(.S-')|/rl  <  X(T')     ...... 
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Ndw  taking  conditional  expectations  vvitli  rcsjioct  to  Jj  nniltijilyinp;  l)y  1^-  on  Ixith  sirlrs  Rives 

\a-E\X{S')\7t]  <  Ia'E[X{T')\7t]     a..<,. 
Since  A'  E  Jt  and  since  \a<X.{S')  ^  \a'X[S)  and  \a'X[T')  =  l,vA^(T),  we  have 

E\X[S)\7t\  <  X(T)      n.s.  on  tlie  set  A\ 

a  clear  contradiction. 

I 

Lemma  3.2.    Lef  X  ho  a  .sti/)eniia;f;;ipa/e  .satisfying^  roiuJifinn  A~ .   Thm  X  is  su[>cr  regular. 

Proof.  From  the  hyjjothesis,  we  know  Hni/^-^  A'(<)  exists  and  is  finite,  and  Z?[A''~(oo)]  <  oo, 
where  A(oo)  is  understood  to  l>e  the  hniit;  cf.  Mertens  [19C9,  Theorem  4].  If  X  also  satisfies 
condition  A^ ,  the  assertion  follows  from  Dellacherie  and  Mt^yer  [1982.  Remark  5a  of  Appendix  I], 
since  {X{f),t  G  9?+}  is  a  snpermartinp^ale. 

For  the  general  case,  let  T  <  .'»  he  two  Markov  times.  For  any  constant  c.  we  jmt  X'^  =  X  /\c. 
Then  the  process  A'*"  satsifies  conditions  A'^  ans  A^ .  Also,  since  minimum  is  a  concave  function, 
A*"  is  a  supermartingale.   Using  the  arguments  in  the  iirevif)us  i);).ragraph,  we  know 

E\X'(S)\Tt]<X'(T)     a.s. 

Fatou's  lemma  implies  that 

^flim  X''(S)\Tt]  <   liiii  X'iT)     «..■.. 

Lr— oo  J  r— oo 

Hence 

E\X(S)\Tt]<X(T)     a.s. 

That  is,  A  is  super  regular. 

I 

The  optional  process  Y  is  said  to  lie  above  the  ojitional  ])i(icess  W.  denoted  by  Y  >  W ,  if 
Y(ujj)  >  W{uj,t)  for  all  (w,t)  outside  a  subset  of  n  X  di^  whose  i)rojection  on  U  is  of  P-measure 
7,ero. 

A  regular  supermartingale  Y  is  the  niinimnm  vrgiihv  su])rnn:utiitgnlr  (MBS)  above  an  optional 
process  W  if  Y  >  W  and  if  A  >  F  for  any  other  regular  su])ermartingale  A  >  IV. 

The  following  jnoposition  follows  directly  from  Mertens  [19G9,  Theorem  7]  and  Lemma  3.2. 
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rrnpositioii    3.1.    Civr,,  T^,.   tli'ir  rxi.^ts  a  MPS  VAT,)   lyim:  Hl«'vr  s,(T_,).     If  z,(l:T^,)  ;s 
rit^lil'nitliniKiiis.  y,{t:T^,)  j.s  rif^ltt  inntiiniKH^    Fnitliriinitrc.  }',(7'_,)  is  sii/ir;  I't^iilnr  ami 


ttnd 


liiii  y,{t:Y_,)  =  liIllsuI),_,.^(n 


}',((); r_,)  =  sup  £;[r,(r,;r_,i 

T,eT 


Pri'nf.  Till-  first  assertion  follows  from  tlm  fart  that  z,(r_,)  satisfies  rfjiidition  /I  and  Mcrtrns 
(19G9,  Tlionrrm  7).  The  soroiul  assertion  follows  from  Remark  23  of  Ajipenriix  I  of  Dellarlierie  and 
Meyer  (1982], 

Tlie  rest  of  the  assertions  follows  from  Lemma  3.2,  Mertens  (19G9,  Theorem  7),  and  the  fart 
that  Y(oo)  i."*  finite  a..t.  sinre  Y  satisfies  A~  (see  again  Merten.s  [19G9.  Theorem  4]). 

I 

We  shall  heneefoith  nse  the  notation  introduced  in  Proposition  3  1 
The  following  result  is  also  useful: 

Proposition  3.2.    F<>r  rvriy  M^rknv  tiinr  S  wr  l]^vr  ;)/i(josf  sr;rr/y 

y,(.9;r_,)   =   e...ssup,ex,r>5^[-.(^;7'_,)|75l. 

Prnnf   See  Theorem  22  of  Ai)i)endix  I  of  Dellarherie  anrl  Meyer  (1982). 

I 
Now  define  a  Markov  time  T,{T-i): 

r,(7'_,)  =  inf{<  G  3?+  :  ¥(()  =-  ?(^;T_,)}, 

Here  is  our  main  theorem  of  this  sertion     It  shows  that  under  some  conditions  ther(>  always 
exists  for  ])layer  ?  a  best  resjionse  to  other  players"  strategies 

TheorPtTi  3.1.  .S'u/i/iMse  thnt  z^T^,)  is  u]>jiri-srini-r<<iitiniii>iis  fioin  thr  iif:lit.  (/u;iM-u/)pe/-.sr;jii- 
mnliniinii^  funu  tlir  Irft ,  nml  .saf/.s/irs  ffinihtinn  A^  .    Th'ii  T,{T  ,)  is  thr  }>rst  ;rs/)onsr  to  T^,. 

Pronf.  Using  Lemma  3.2,  the  assertion  follows  fr<uii  similar  arguments  of  Theorem  7.3  of  Tliomi)son 
[1071] 

I 

From  now  on  we  sliall  assmne  tjial  riMiditions  of  Theorem  3  1   on  the  reward  jiroresses  are 
satisfied. 

The  following  |)roj)ositions  give  some  jjroperties  of  an  optimal  leaction 


Proposition   3.3.    Fix  r_,-.    Let  r,  }>r  n  host  rcfijinnsr  fny  jtlnyrr  i  nnd  lot  Yj{T.i)  l)c  the  MBS 
innjoiiiig  z,(T_,).   Then 

Y,{Ti-T^i)  =  Zi{T,:T_i)    n..«..  (3.4) 

r,(r_,)  <  r,-      a.s.,  (3.5) 

and 

E[Y,{T,-T.,)]  -y,(n;r_,).  (3.G) 

Proof.    Dy  the  fart  that  y,(T_,)  is  pnjxu'  regular  (cf.    Lniiiiia  3.2),  that  r,  is  a  heat  icspoiise,  and 
that  y,(r_,)  hes  ahove  z,(r_,),  wo  have 

e[y,(t,: r_,)i  <  y,(n; r_,)  =  i?[2,(r,: r_,))  <  e[yAt,- r_,)).  (3.7) 

whrio  the  equality  follows  from  Projiosition  3.2.  Hrnrc 

E[Y.(r,:T_,)\  =  E[z,iT,:T.,)]. 

It  then  follows  from  the  fart  that  Y,{T^,)  >  2,(r_,)  r/,..«.  aii<l  th(-  fact  that  2,(r_,)  satisfies  A'^  and 
A- 

y,(r,;r_,)  =  2,(r,;T_,)    „.... 

This  is  (3.4) 

By  the  definition  of  r,(r_,).  we  then  have  r,(r_,)  <  r,  a..<i.,  whirh  is  (3.5). 
Argnments  used  to  prove  (3.7)  proves  (3.G),  sinee  T,  is  an  oi)tiiiial  response. 

I 

Note  that  (3.5)  implies  that  r,(r_,)  is  the  nni<ine  minimum  best  response  for  player  t,  given 
that  his  opponents  play  T_,-. 

Proposition  3.4.    Lot  r,  l>c  an  optimal  j-e.spon.se  tn  T^j  a.n<l  Irt  S  1)r  n.  Marknv  tiiiic   Then 

E\z,(r,-T_i)\Ts]  >  z,(-'^-T-i)    on  the  set  {S  <  r,}. 
Proof.  Proposition  3.2  anci  arguments  similar  to  Lemma  3.1  imjily  that,  on  the  set  {r,  >  S}, 

E\z,ir,:T_i)\rs]  =  Y,{S-T^,)  >  Zi{S-T.i)  «...., 

whirh  was  to  he  proved. 

I 

4.  Nash  equilibria  when  2,'s  have  a  monotone  structure 

hi  this  section  we  will  show  that  there  exists  a  Nash  ('(piililnium  wIkmi  the  reward  processes  of 
jilayers  satisfy  a  monotone  structure. 
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Tlir  fi)lli>wiiip;  a.s^uinptidii  will  he  made  tliri'iifilKiiit  tliis  scrtinn. 
Assumption  4.1.    For  t.  «'  €  5R,   an./  I   >  t' .  a/jimsf  siiiWy.  c,(w. /:  r_,(w))  -  z,(w, «';  r_,(w))  is 
noiiiitrrrnsiiig  in  r_,(u') 

DrnotiiiK  by  T'*^'  tlw  r.ill(-rtif)ii  of  yV-tui)li-  of  Markov  tiiiics.  we  di-finc  4>  :  T''^'  ►-»  T''^'  .-v; 

i'(r, rA.)  =  (r,(T„,))f:,. 

By  Tli<^or<Mii  3  1.  ^  i?  a  rrartiou  fuiichon  for  tlic  A'  playis  By  Tin'ornii  3.1,  tin-  iiia])])iiif^  is 
wril-drfiiird. 

Tlir  iiiai>piiiK  ^  is  said  to  hr  tu'ninUiur  if  for  any  two  Maikov  times  r  >  S.  t  =  4>(r)  and 
.«?'  =  *(.<?)  ii„],lirs  r'  <  .<?'. 

The  following  j)ioj)opitioii  siiows  that  <I>  is  luonotonc. 

Proposition  4.1.   <I'  is  /iioijofone. 

Prnfif.  ('honso  two  Maikov  tiiiirs  r  >  S.  Let  r'  =  ^(r)  and  .S''  =  4>(.9).  Snpjjose  tiie  set 

is  of  strirtly  i)ositive  measure  for  sonie  t.  By  Assnm])tion  4.1  we  know  almost  surely. 

\z,{t':t_,]-z,(S]:t_,)\\,^ 
<\z,(T',:S_i)-Zi(S'.:S_i)\i^. 
Taking  conditional  expectations  with  respect  to  7s'  on  hotli  sides  of  the  above  relation  gives 

0  <E\zi{T\:T_,)  -  z,(S',:t_,)\7s']\a 
<E\z,(T,:S^i)  -  z,(S',:S_,)\Js'\\a  <  0, 
where  we  have  used  the  fart   tiiat    A  G    Ts'   (<f     Delhu  h(-ri<'  and  Meyer  [1978.   Theorem   IV. 5C]). 
where  tlie  first  inecjuality  follows  from  Proposition  3  4.  and  whric  tlic  tliird  ini(|u:ility  follows  from 
Proposition  3.2.  Thus 

E\z,{r',:r.,)\Tsi]^  zAS',:t_,)     .i..«    on  the  set  A  (4.1) 

Now  define  rr,  =  S^  A  T-  a.K.  It  is  easily  elierked  that  rr,  is  a  Markov  tim<'  and  rr,  <  r, .  rr,  ^  r,- 

on  a  set  of  stiictly  jiositive  measure.    W<'  claim  that   n,  is  :\  Ix-st   resixinse  to  r_,     To  see  this,  we 

note  tliat 

ElzAry^.T-i)]  =  El.-,(.S;;r„,)l,4  +  r,( r,';  r.,)rj 

=  E  [e\z,(S',:t.,]1.^  +  c,(r;;r_,)l..i,  |J5;l] 
=  E\z,(T::r.,)]. 
wliere  we  have  tised  (4.1)  and  where  A"^  denotes  U  \  >1.    This  is  a  contradiction  to  the  fact  that 
t'-  =  <[>(r_,)  is  the  unique  minimum  best  resjxmse  to  r„,    Thus  A  nuist  be  of  measure  z.ero 

I 
The  following  is  the  first  main  theorem  of  this  section: 
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Theorem  4.1.    Tlirrc  exists  a  Nash  rquijiliriiun  <<f  the  sfn/i/tnip  pajjir. 

rrnof.  From  rroposition  4.1  $  is  a  monotoiir  maiiiiiiiK  hmn  T'  in  itself.  Proixisition  VI. 1.1  of 
Nrveu  [1975]  implies  that  T^  is  a  complete  lattice.  It  then  follows  from  Tarski's  fixpoint  theorem 
(cf.  Tarski  [1955])  that  there  exists  a  fixpoint  for  ^.  It  is  easily  verified  that  the  fixpoint  is  a  Nash 
eqnilibrinm. 

I 

The  following  theorem  shows  that  if  we  have  a  symmetric  game,  that  is,  for  any  (A^  —  l)-tuple 
of  Markov  times  T  we  have  z,(w,  t;  T)  —  zj{uj,  t;  T)  except  on  a  subset  of  U  X  3?_|.  whose  projection  to 
n  is  of  measure  zero,  then  there  exists  a  imi<ine  symmetric  etinilihrinm.  provided  that  the  following 
asRiiniption  is  satisfied. 

Assumption  4.2.  For  f.  t'  G  3?.^  mid  t  >  t' .  nlnmst  suirly.  2,(w.  <;  r_,(w))  -  2,(w, /.';  r_,(w))  is 
strirfly  (irrrrnsing  in  T_,(w). 

A  definition  is  needed.  Let  'P  l)r  a  mapi)ing  fmni  T'  to  all  the  subsets  of  T'  that  gives  all 
the  l)ost  responses  to  an  element  of  T  .  By  Theorem  3.1,  '^  is  well-defined.  We  call  'I'  the  rcartion 
raiTcsjinndrurc.  The  reaction  corresi)ondence  is  said  to  he  monofojie  if  for  any  two  Markov  times 
7-  >  .9  a.s..  and  r'  G  'l'(r),  S'  G  *(.9),  we  have  r'  <  S' .  ,i..9. 

The  following  jiroposition  shows  that  ^  is  monotone,  whose  proof  is  similar  to  that  of  Propo- 
sition 4.1. 

Proposition  4.2.   ^  is  monotono  if  Assuinptimi  4.2  is  sntisfirt] 

rrnnf.  Choose  two  Markov  times  r  >  S.  Let  r'  =  ^(r)  and  .*>'  =  ^>(.'>).  Suppose  the  set 

A={r',>S:} 

is  of  strictly  i)ositive  measure  for  some  i.  By  Assuinjition  4.1  we  know  almost  surely, 

[^,(r;;r_,)-^,(5;:^_,)]l., 
<[z,(r:-S_,)-z,{S',:S_,)]l,,. 
Taking  conrlitional  exi)ectations  with  resjjcct  to  Ts'  f'H  both  sid(~s  of  the  above  relation  gives 

E[z,(r',:T_,)-z,{S',:r_,)\rs;]lA 
<E{z,(r::S_,)-z,(S::S.,)\rs;]lA. 
where  we  have  used  the  fact  that  AG  Ts'-  ^^    Dellach(-ri(>  aufl  Meyer  [1978,  Theorem  IV. 5G].   The 
left-liand-sirle  of  the  relation  is  nonnegative  almost  surely  by  Proposition  3.4.     Hence  the  right- 
hand-side  is  strictly  jiositive  and  is  a  contradiction  to  Proposition  3.2.  Thus  A  nnist  be  of  measure 


Here  is  theorem: 


Thporem  4.2.    Siippn^^r  f/j,if  thr  f^nuir  is  syiiintrtiji-  nii'l  thnt  A^^iiinpti'ni  4  2  if:  sntiafjcd    Tlirn 
tlt'Tf  rxisfs  a  iiniiiuf  f^yiiunrtrii'  N:ish  '■ipuljlirinin  {"V  tli>-  sliij)])iut^  t^mii'-. 

Proof.    Lft 

aiul  lot  F(r)  -  Dfl'I'lT')  =ii>fl  F'(r)  =  Dn*(7')  f'"  '■'"  T  G  T'^'. 

Note  f}l^t  for  o^rli  T  e  D.  4>,(r_,)  =  ^j{T_j)  a.f  for  all  i.j.  wlicic  1>,(r)  <l<liotcp  thr  j-tll 
roiiipoiiriit  of  4>(T).  So  FfT)  is  iionciiipty  and  F  D  >—*  D  i^  iiionntoiic  sinrc  <I>  is.  Tims  F  has  a 
fixrd  jxiiiit  aiifl  thrrr  exists  a  .syminrtiir  ( fjuilihriuin 

Lot  T'  1'c  a  fixrd  point  of  F  and  tlirrofmc  is  oni-  for  F' .  ("lioosc  T  ^  D  with  T  >  T'  n.s. 
Sinro  r*  e  *(r*).  by  mouotonirity  T'  <  T'  a.fl.  for  all  T'  G  F'(r)  C  *(r)    So  T'  <  T  ti.-t.  and 

r^  *(r). 

Similarly.  T  <  T'  «  .'  implies  T  ^  'I'fT')  Tlicrrfoic,  T*  must  ])r  tlie  nniqni-  symnictrir 
Ofpiililiritim. 

I 

Fnially,  we  have 
Theorprn  4.3.   Any  iVa.s/i  r(jiii]i}<iiuiii  nf  thr-  .sfo/i/u'/ij^  i^ainr  /s  su/'i^a/de  jirrff-t. 
Proof.  Tliis  follow?  from  ar^imrnts  similar  to  Lonima  3.1  and  Proposition  3.2. 


5.  Concluding  remarks 

As  wo  iiavo  mentioned  in  the  introfhirtion.  this  version  is  ])reliminary  and  inromjilete.  We 
demonstrated  the  existence  of  a  Nasli  ecjiiilibriiuii  in  a  rlass  of  ((iiitinuous  time  stojjjjinp:  Rame.s. 
We  are  still  working  on  showing  the  unifjueness  of  an  i'(jnilil)iinni  and  on  constrnetinR  example.s  of 
general  interest. 
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